A Hybrid Method for Training Convolutional Neural Networks
نویسندگان
چکیده
Artificial Intelligence algorithms have been steadily increasing in popularity and usage. Deep Learning, allows neural networks to be trained using huge datasets also removes the need for human extracted features, as it automates feature learning process. In hearth of training deep networks, such Convolutional Neural Networks, we find backpropagation, that by computing gradient loss function with respect weights network a given input, adjusted better perform task. this paper, propose hybrid method uses both backpropagation evolutionary strategies train where are used help avoid local minimas fine-tune weights, so achieves higher accuracy results. We show proposed is capable improving upon regular task image classification CIFAR-10, VGG16 model was final test results increased 0.61%, average, when compared only backpropagation.
منابع مشابه
Towards dropout training for convolutional neural networks
Recently, dropout has seen increasing use in deep learning. For deep convolutional neural networks, dropout is known to work well in fully-connected layers. However, its effect in convolutional and pooling layers is still not clear. This paper demonstrates that max-pooling dropout is equivalent to randomly picking activation based on a multinomial distribution at training time. In light of this...
متن کاملIntroducing a method for extracting features from facial images based on applying transformations to features obtained from convolutional neural networks
In pattern recognition, features are denoting some measurable characteristics of an observed phenomenon and feature extraction is the procedure of measuring these characteristics. A set of features can be expressed by a feature vector which is used as the input data of a system. An efficient feature extraction method can improve the performance of a machine learning system such as face recognit...
متن کاملSemi-Supervised Training of Convolutional Neural Networks
In this paper we discuss a method for semi-supervised training of CNNs. By using auto-encoders to extract features from unlabeled images, we can train CNNs to accurately classify images with only a small set of labeled images. We show our method’s results on a shallow CNN using the CIFAR-10 dataset, and some preliminary results on a VGG-16 network using the STL-10 dataset.
متن کاملImplementation of Training Convolutional Neural Networks
Deep learning refers to a shining branch of machine learning that is based on learning levels of representations. Convolutional Neural Networks (CNN) is one kind of deep neural network. It can study concurrently. In this article, we use convolutional neural network to implement the typical face recognition problem which can overcome the influence of pose or resolution in face recognition. Then,...
متن کاملIncremental Training of Deep Convolutional Neural Networks
We propose an incremental training method that partitions the original network into sub-networks, which are then gradually incorporated in the running network during the training process. To allow for a smooth dynamic growth of the network, we introduce a look-ahead initialization that outperforms the random initialization. We demonstrate that our incremental approach reaches the reference netw...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture notes in networks and systems
سال: 2021
ISSN: ['2367-3370', '2367-3389']
DOI: https://doi.org/10.1007/978-3-030-80129-8_22